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Description 

METHOD FOR DECIMATING IMAGE DATA 
FILTERED BY A BAYER PATTERN COLOR 

FILTER ARRAY 

Background of Invention 
[0001] i. Field of the Invention 

[0002] The present invention relates to a method for decimating 
an image data, and more particularly, to a method for 
decimating an image data filtered by a Bayer pattern color 
filter array. 

[0003] 2. Description of the Prior Art 

[0004] Bayer pattern color filter array is widely applied to image 
sensors of image-capturing devices for filtering color in- 
formation of light emitted from the capturing object. 
Please refer to Fig.l. Fig.l is a color filter arrangement di- 
agram of a Bayer pattern color filter array 10. The Bayer 
pattern color filter array 10 includes a plurality of patterns 
12 arrayed in a matrix. Each pattern 12 includes three 



kinds of color filters arrayed in a 2x2 matrix. The three 
kinds of color filters are a red color filter, a blue color I 
filter, and a green color filter. As shown in Fig.l, "r" sym- 
bolizes the red color filter, "g" symbolizes the green color 
filter, and "b" symbolizes the blue color filter. There are 
one red color filter, one blue color filter, and two green 
color filters in each pattern 12 because it is based on the 
fact that human visual system is more sensitive to the 
green color information than to the red and blue informa- 
tion. Please refer to Fig. 2. Fig. 2 is a diagram of four pos- 
sible organizations of the pattern 12. There are four pos- 
sible organizations 12a, 12b, 12c, 12d of the pattern 12 
according to different color arrangements. Basically the 
two green color filters are positioned in a diagonal direc- 
tion instead of being positioned closely. The red color fil- 
ter and the blue color filter are also positioned in a diago- 
nal direction. 

[0005] please refer to Fig. 3. Fig. 3 is a color arrangement diagram 
of a first image data 14 filtered by the Bayer pattern color 
filter array 10. The first image data 14 is a 4x4 pattern 12 
matrix and is also a 8x8 pixel matrix. The first image data 
includes a first area 18, a second area 20, a third area 22, 
and a fourth area 24. Please refer to Fig. 4. Fig. 4 is a color 



arrangement diagram of decimating the first image data 
14 to a second image data 26 conventionally. The deci- 
mation method is keeping the upper-left patterns 12 of 
the first area 18, the second area 20, the third area 22, 
and the fourth area 24 and deleting other pattern 12. So 
the second image data 26 is composed of the four pat- 
terns 12 sampled from the four areas, and the size of the 
second image data 26 is one quarter of the size of the 
first image 14. The small letter "r" shown in Fig. 3 and 
Fig. 4 symbolizes the red pixel datum of the first image 
data 14. The small letter "g" shown in Fig. 3 and Fig. 4 
symbolizes the green pixel datum of the first image data 
14. The small letter "b" shown in Fig. 3 and Fig. 4 symbol- 
izes the blue pixel datum of the first image data 14. The 
capital letter "R" shown in Fig. 3 and Fig. 4 symbolizes the 
red pixel datum of the second image data 26. The capital 
letter "G" shown in Fig. 3 and Fig. 4 symbolizes the green 
pixel datum of the second image data 26. The capital let- 
ter "B" shown in Fig. 3 and Fig. 4 symbolizes the blue pixel 
datum of the second image data 26. The upper-left pat- 
tern 12 of the second image data 26 has the following re- 
lation with pixels of the first area 18 of the first image 
data 14: G00=g00, R01 = r01, B10=bl0, Gll=gll; Simi- 



larly the upper-right pattern 12 of the second image data 
26 has the following relation with pixels of the second 
area 20 of the first image data 14: G02=g04, R03 = r05, 
B12 = bl4, G13=gl5; The lower-left pattern 12 of the sec- 
ond image data 26 has the following relation with pixels 
of the third area 22 of the first image data 14: G02=g04, 
R03 = r05, B12 = bl4, G13=gl5; The lower-right pattern 12 
of the second image data 26 has the following relation 
with pixels of the fourth area 24 of the first image data 
14: G22=g44, R23 = r45, B32 = b54, G33=g55. 
[0006] please refer to Fig. 5. Fig. 5 is a color arrangement diagram 
of decimating the first image data 14 to a third image 
data 28 conventionally. The decimation method is keeping 
the four pixels gOO, r03, b30, g33 in four corners of the 
first area 18, the four pixels g04, r07, b34, g37 in four 
corners of the second area 20, the four pixels g40, r43, 
b70, g73 in four corners of the third area 22, and the four 
pixels g44, r47, b74, g77 in four corners of the fourth 
area 24 and deleting other pixels. So the third image data 
28 is composed of the sixteen pixels sampled from the 
four corners of the four areas. That is, the upper-left pat- 
terns 12 of the third image data 28 is composed of the 
pixels gOO, r03, b30, g33 in four corners of the first area 



18 of the first image data 14, wherein G00=g00, 
R01 = r03, B10=b30, Gll=g33. Similarly the other pat- 
terns 12 of the third image data 28 are composed of the 
pixels g04, r07, b34, g37 of the second area 20 of the 
first image data 14, the pixels g40, r43, b70, g73 of the 
third area 22, and the pixels g44, r47, b74, g77 of the 
fourth area 24 individually. 
[0007] These two afore mentioned Bayer Pattern decimation pro- 
cesses are simple and widely realized in the hardware im- 
plementation, mostly integrated with the image sensor 
circuits. However these two decimation processes can 
cause staircase discontinuity on titled straight lines and 
titled straight object edges. Therefore, the visual quality 

on the final decimated results is degraded. 
Summary of Invention 

[0008] it j S therefore a primary objective of the claimed invention 
to provide a method for decimating an image data filtered 
by a Bayer pattern color filter array for solving the above- 
mentioned problem. 

[0009] According to the claimed invention, a method for deci- 
mating a first image data filtered by a Bayer pattern color 
filter array is proposed. The first image data includes a 
plurality of patterns arranged in an array, and each pat- 



tern includes a first color pixel. The method includes pro- 
viding first color pixel weighting values of the plurality of 
patterns of the first image data, and summing up the first 
color pixel weighting values to generate a first color pixel 
of a second image data decimated from the first image 
data. 

[0010] These and other objectives of the claimed invention will 

no doubt become obvious to those of ordinary skill in the 

art after reading the following detailed description of the 

preferred embodiment that is illustrated in the various 

figures and drawings. 
Brief Description of Drawings 

[0011] pig.l is a color filter arrangement diagram of a Bayer pat- 
tern color filter array. 

[0012] pig. 2 is a diagram of four possible organizations of the 
pattern. 

[0013] pig. 3 is a color arrangement diagram of a first image data 
filtered by the Bayer pattern color filter array. 

[0014] Fig. 4 is a color arrangement diagram of decimating the 
first image data to a second image data conventionally. 

[0015] Fig. 5 is a color arrangement diagram of decimating the 
first image data 14 to a third image data conventionally. 

[0016] Fig. 6 is a flowchart of decimating the first image data fil- 



tered by the Bayer pattern color filter array according to 
the present invention. 

[0017] pig. 7 is a color arrangement diagram of decimating the 
first image data to the fourth image data according to a 
first embodiment of the present invention. 

[0018] pig. 8 is a color arrangement diagram of a fifth image data 
according to a second embodiment of the present inven- 
tion. 

[0019] Fig. 9 is a color arrangement diagram of decimating the 
fifth image data to a sixth image data according to the 
second embodiment of the present invention.. 

[0020] Fig. 10 is a color arrangement diagram of decimating the 
first image data to a seventh image data according to a 
third embodiment of the present invention. 

[0021] Fig. 11 is a color arrangement diagram of decimating the 

fifth image data to an eighth image data according to a 

fourth embodiment of the present invention. 
Detailed Description 

[0022] please refer to Fig. 6. Fig. 6 is a flowchart of decimating the 
first image data 14 filtered by the Bayer pattern color filter 
array 10 according to the present invention. The method 
includes: 

[0023] step 100:Provide green pixel weighting factors of the plu- 



rality of patterns 12 of the first image data 14; 

[0024] step 102:Provide red pixel weighting factors of the plural- 
ity of patterns 12 of the first image data 14; 

[0025] step 104:Provide blue pixel weighting factors of the plu- 
rality of patterns 12 of the first image data 14; 

[0026] step 106:Generate the products of the green pixel weight- 
ing factors of the plurality of patterns 12 and the corre- 
sponding green pixel signals, and sum up the products to 
generate green pixel signals of a fourth image data 30 
decimated from the first image data 14; 

[0027] step 108:Generate the products of the red pixel weighting 
factors of the plurality of patterns 12 and the correspond- 
ing red pixel signals, and sum up the products to gener- 
ate red pixel signals of a fourth image data 30 decimated 
from the first image data 14; and 

[0028] step 110:Generate the products of the blue pixel weight- 
ing factors of the plurality of patterns 12 and the corre- 
sponding blue pixel signals, and sum up the products to 
generate blue pixel signals of a fourth image data 30 dec- 
imated from the first image data 14. 

[0029] please refer to Fig. 7. Fig. 7 is a color arrangement diagram 
of decimating the first image data 14 to the fourth image 
data 30 according to a first embodiment of the present 



invention. The small letters "r, g, b" shown in Fig. 7 sym- 
bolize the red, green, blue pixel data of the first image 
data 14. The capital letters "R, G, B" shown in Fig7 sym- 
bolize the red, green, blue pixel data of the fourth image 
data 30. A first pattern 32 in the upper-left corner of the 
fourth image data 30 can be decimated from the pixels in 
the first area 18 of the first image data 14. A second pat- 
tern 34 in the upper-right corner of the fourth image data 
30 can be decimated from the pixels in the second area 
20 of the first image data 14. A third pattern 36 in the 
lower-left corner of the fourth image data 30 can be deci- 
mated from the pixels in the third area 22 of the first im- 
age data 14. A fourth pattern 38 in the lower-right corner 
of the fourth image data 30 can be decimated from the 
pixels in the fourth area 24 of the first image data 14. 
[0030] The process about decimating the pixels in the first area 
18 of the first image data 14 to the first pattern 32 in the 
upper-left corner of the fourth image data 30 is described 
as follows. First the green pixel weighting factors iOO, i02, 
ill, i20, i22 corresponding to the green pixels gOO, g02, 
gll, g20, g22 in the first area 18 of the first image data 
14 are provided. The green pixel GOO of the first pattern 
32 of the fourth image data 30 can be generated from the 



following rela- 

tion:G00=i00*g00+i02*g02+ill*gll + i20*g20+i22*g22. 
The sum of the five green pixel weighting factors iOO, i02, 
ill, i20, i22 can be 1 so that the luminance of the green 
pixel GOO can be equal to the luminance of the green pix- 
els of the first image data 14 approximately. The posi- 
tions of the green pixels gOO, g02, gll, g20, g22 in the 
first image data 14 are corresponding to the position of 
the green pixel GOO in the fourth image data 30. So the 
decimation method according to the present invention can 
keep the luminance conservation and reduce the distor- 
tion of the spatial distribution effectively. 
[0031] using the same logic, the red pixel weighting factors jOl, 
j03, j21, j23 corresponding to the red pixels rOl, r03, r21, 
r23 in the first area 18 of the first image data 14 are pro- 
vided. The red pixel ROl of the first pattern 32 of the 
fourth image data 30 can be generated from the following 
relation: R01=j01*r01+j03*r03+j21*r21+j23*r23. The 
sum of the four red pixel weighting factors jOl, j03, j21, 
and j23 can be 1. The blue pixel weighting factors klO, 
kl2, k30, k32 corresponding to the blue pixels blO, bl2, 
b30, b32 in the first area 18 of the first image data 14 are 
provided. The blue pixel BIO of the first pattern 32 of the 



fourth image data 30 can be generated from the following 
relation: B10=kl0*bl0+kl2*bl2 + k30*b30+k32*b32. 
The sum of the four blue pixel weighting factors jOl, j03, 
j2 1, and j23 can be 1. The green pixel weighting factors 
mil, ml3, m22, m31, m33 corresponding to the green 
pixels gll, gl3, g22, g31, g33 in the first area 18 of the 
first image data 14 are provided. The green pixel Gil of 
the first pattern 32 of the fourth image data 30 can be 
generated from the following relation: 
Gll = mll*gll + ml3*gl3+m22*g22 + m31*g31 + m33*g3 
3. The sum of the five green pixel weighting factors mil, 
ml3, m22, m31, and m33 can be 1. In conclusion, the 
first pattern 32 of the fourth image data 30 is composed 
of the pixels GOO, R01, BIO, Gil. Using the same logic, 
the second pattern 34, the third pattern 36, and the 
fourth pattern 38 also can be generated by the above- 
mentioned method. 
[0032] if the type of the pattern 12 of the first image data 14 is 
not the type of the pattern 12a shown in Fig. 2 and be- 
longs to the types of the pattern 12b, 12c, or 12d, the 
above-mentioned decimation method also can be used. 
For example, please refer to Fig. 8. Fig. 8 is a color ar- 
rangement diagram of a fifth image data 40 according to 



a second embodiment of the present invention. The fifth 
image data 40 is composed of the pattern 12c. Fig. 9 is a 
color arrangement diagram of decimating the fifth image 
data 40 to a sixth image data 42 according to the second 
embodiment of the present invention. Using the same 
decimation method, the pixels of the sixth image data 42 
has the following relation with the pixels of the fifth im- 
age data 40: 
[0033] R00=i00*r00+i02*r02 + i20*r20+i22*r22; 

[0034] G01=j01*g01+j03*g03+jl2*gl2+j21*g21+j23*g23; 

[0035] G10=kl0*gl0+kl2*gl2+k21*g21 + k30*g30+k32*g32; 

[0036] Bll = mll*bll + ml3*bl3+m31*b31 + m33*b33; 

[0037] The red pixel weighting factors iOO, i02, i20, i22 are cor- 
responding to the red pixels rOO, r02, r20, r22 of the fifth 
image data 40 and to generate the red pixel ROO of the 
sixth image data 42. The green pixel weighting factors 
jOl, j03, j 12, j21, j23 are corresponding to the green pix- 
els gOl, g03, gl2, g21, g23 of the fifth image data 40. 
The green pixel weighting factors klO, kl2, k21, k30, k32 
are corresponding to the green pixels glO, gl2, g21, g30, 
g32 of the fifth image data 40. And the blue pixel weight- 
ing factors mil, ml3, m31, m33 are corresponding to 



the blue pixels bll, bl3, b31, b33 of the fifth image data 
40. The sum of the four red pixel weighting factors iOO, 
i02, i20, and i22 can be 1. Similarly, the sum of jOl, j03, 
j 12, j2 1, j23, the sum of klO, kl2, k21, k30, and the sum 
of mil, ml3, m31, and m33 can be 1. The other pixels of 
the sixth image data 42 also can be generated by the 
above-mentioned decimation method. 

[0038] if the decimation complexity and cost are the major con- 
cern, the above-mentioned decimation method can be 
simplified by selecting certain values for weighting fac- 
tors. Please refer to Fig. 10. Fig. 10 is a color arrangement 
diagram of decimating the first image data 14 to a sev- 
enth image data 44 according to a third embodiment of 
the present invention. The pixels of the seven image data 
44 has the following relation with the pixels of the first 
image data 14: 

[0039] G00=i00*g00+ill*gll; 

[0040] R01=j01*r01+j03*r03; 
[0041] B10=k30*b30+k32*b32; 
[0042] Gll = m22*g22 + m33*g33; 

[0043] The green pixel weighting factors iOO, ill are corre- 
sponding to the green pixels gOO, gll of the first image 



data 14 and to generate the green pixel GOO of the sev- 
enth image data 44. The red pixel weighting factors jOl, 
j03 are corresponding to the red pixels rOl, r03 of the 
first image data 14. The blue pixel weighting factors k30, 
k32 are corresponding to the blue pixels b30, b32 of the 
first image data 14. And the green pixel weighting factors 
m22, m33 are corresponding to the green pixels g22, g33 
of the first image data 14. The other pixels of the seventh 
image data 44 also can be generated by the same decima- 
tion method. In the third embodiment of the present in- 
vention the weighting factors i02, i20, i22, j2 1, j23, klO, 
kl2, mil, ml3, m31 of the first embodiment are set to 0. 
That is, the pixels g02, g20, g22, r21, r23, blO, bl2, gll, 
gl3, g31 of the first image data 14 are not sampled in the 
third embodiment. So the data operating and buffer size 
in the third embodiment is about one half of the one in 
the first embodiment. As a result, this embodiment pro- 
vides a low complexity and low cost implementation for 
the present invention. Furthermore pixels are sampled in 
each row and column of the original first image data 14 so 
that staircase discontinuity on titled straight lines and ti- 
tled straight object edges can be eliminated and the visual 
quality on the final decimated results is upgraded. 



[0044] if the type of the pattern 12 of the first image data 14 is 
not the type of the pattern 12a shown in Fig. 2 and be- 
longs to the types of the pattern 12b, 12c, or 12d, the 
above-mentioned decimation method in the third embod- 
iment also can be used. For example, please refer to 
Fig. 11. Fig. 11 is a color arrangement diagram of decimat- 
ing the fifth image data 40 to an eighth image data 46 ac- 
cording to a fourth embodiment of the present invention. 
Using the same decimation method, the pixels of the 
eighth image data 46 has the following relation with the 
pixels of the fifth image data 40: 

[0045] R00=i00*r00+i02*r02; 

[0046] G01=j03*g03+jl2*gl2; 
[0047] G10=k21*g21 + k30*g30; 
[0048] Bll = m31*b31 + m33*b33; 

[0049] The red pixel weighting factors iOO, i02 are corresponding 
to the red pixels rOO, r02 of the fifth image data 40 and to 
generate the red pixel ROO of the eighth image data 46. 
The green pixel weighting factors j03, j 12 are corre- 
sponding to the green pixels g03, gl2 of the fifth image 
data 40. The green pixel weighting factors k21, k30 are 
corresponding to the green pixels g21, g30 of the fifth 



image data 40. And the blue pixel weighting factors m31, 
m33 are corresponding to the blue pixels b3 1, b33 of the 
fifth image data 40. The other pixels of the eighth image 
data 46 also can be generated by the same decimation 
method. 

[0050] | n conclusion, the method according to the present inven- 
tion is for weighting pixels of an image data filtered by a 
Bayer pattern color filter array and then summing up the 
weighting values to generate a decimated data. All kinds 
of methods for setting weighting factors are all within the 
scope of the present invention. 

[0051] | n contrast to the prior art, the decimation method ac- 
cording to the present invention is for weighting pixels of 
an original image data and then summing up the weight- 
ing values to generate a decimated data. So the staircase 
discontinuity on titled straight lines and titled straight ob- 
ject edges can be eliminated and the visual quality on the 
final decimated results is upgraded. 

[0052] Those skilled in the art will readily observe that numerous 
modifications and alterations of the method may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



